Columbia is an unincorporated community and census-designated place (CDP) located within Knowlton Township in Warren County, in the U.S. state of New Jersey. While the community has existed for over a century, the CDP was created as part of the 2010 United States Census. As of the 2010 Census, the CDP's population was 229. The area is served as United States Postal Service ZIP Code 07832.